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ABSTRACT 

Unclassified  historical  data  concerning  the  United  States  in- 
volvement in  military  conflicts  is  used  to  model  the  behavioral  patterns 
of  the  past  as  a  Markov  Process.    The  stochastic  properties  of  the 
model  are  calculated  and  their  usefulness  as  tools  in  the  study  of 
cost-effectiveness  is  discussed. 
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I.    A  COST  EFFECTIVENESS  MODEL 

Within  the  last  few  years  the  term,  "cost-effectiveness"  has 
lost  its  formality  while  extending  and  diversifying  its  applicability  so 
that  it  now  includes  all  phases  of  system  and  component  design, 
development,  production  and  operation.    The  basic  concept  of  cost- 
effectiveness  analysis  as  an  analytical  technique  for  evaluating  alter- 
native choices  having  economic  and  management  implication  has 
produced  evaluation  processes  which  are  extremely  sophisticated  and 
complex,  but  which  fail  at  times  to  provide  the  correct  solution.    The 
ability  to  make  the  correct  decision  involving  an  appropriate  cost  for 
a  system  under  study  remains  difficult  in  itself  and  can  be  made 
virtually  impossible  if  the  decision-maker  is  led  astray  by  analysis 
which  is  biased  by  the  exclusion  and/or  inclusion  of  inappropriate 
cost  categories.    To  determine  the  relative  merits  of  various  weapon 
systems  it  is  imperative  that  the  wartime  cost  categories  be  specifically 
identified  and  standardized.    Another  critical  area,  the  mathematical 
relationship  between  cost  and  effectiveness,  is  still  open  to  debate. 
This  paper  discusses  these  problems  with  regard  to  a  military  weapon 
system  and  develops  a  stochastic  model  which  may  assist  in  the 
search  for  correct  answers. 

A  simple  categorization  of  the  major  cost  categories  for  a  military 
weapon  system  which  can  be  used  as  a  focal  point  for  developing  other 
cost  guidelines  is: 


Research  &  Development  Costs 

Peacetime  Investment  Cost 

Peacetime  Operating  Costs 

Wartime  Investment  Cost 
and      Wartime  Operating  Cost 

In  response  to  a  similar  list  of  cost  categories  TRW  Systems 
Group  has  suggested,  [Ref.   1],  that  system  costs  could  be  more  ex- 
plicitly related  to  system  effectiveness  if  both  were  evaluated  at  the 
same  level  of  military  activity.    For  example,  system  wartime  effec- 
tiveness is  evaluated  under  a  variety  of  missions  and  scenarios, 
therefore,  wartime  operating  costs  should  be  similarly  measured  at 
various  levels  of  war  in  order  to  increase  the  preciseness  of  the  results. 
Additionally,  since  it  is  common  for  the  life-cycle  of  a  weapon  system 
to  span  periods  of  peacetime  and  various  levels  of  military  activity, 
estimates  of  system  life-cycle  cost  should  include  the  utilization  of 
weighting  factors  applied  to  the  various  operating  costs  in  proportion 
to  the  probability  of  the  United  States  being  in  a  state  of  peace  or 
appropriate  level  of  military  involvement  during  a  given  time  period. 
And  finally,  a  weighting  factor  related  to  the  expected  frequency  of 
war  should  also  be  used  to  correctly  apportion  the  contribution  of 
wartime  investment  costs  to  the  total  life-cycle  costs. 

As  a  first  approximation,  the  military  conflicts  can  be  separated 
into  the  two  categories  of  WAR  and  HALF -WAR  relative  to  their  intensity, 

number  of  casualties,  etc.    The  stochastic  properties  mentioned  above 
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can  then  be  applied  to  the  major  cost  categories  to  obtain  a  "top  level" 
probabilistic,  life-cycle  cost  equation  for  use  as  a  guideline  in  final 
cost  estimation  and  as  a  new  analytical  tool  for  gaining  more  insight 
into  the  resource  requirements  to  be  expected  during  a  system's  life- 
time.   This  was  done  by  TRW  Systems  Group  [Ref.  1]  and  the  resulting 
life-cycle  cost  equation  was: 

Life-Cycle  Cost  =  (R&D  cost)  +  (Peacetime  Investment  cost) 

+  nNW-HW      (Investment  Cost/transition)NW_HW 

+  n-_..r  ...         (Investment  Cost/transition).^,.  ... 
NW-W  NW-W 

+  nHW-W         <Investment  Cost/transition)HW_w 
T 

+   I  (PNO-WAR>  (AnnUal  °PS  COStSPEACE> 

k=l  k  k 

T 

+  /      (P        )     (Annual  Ops  costs        ) 
^     V  HALF-WAR^     ^      p      HALF-WAR^ 

T 
+  I     ^wAR^  (Annual  Ops  costs^ 

r 

where  the  P's  are  the  weighting  factors  based  on  the  probability  that 
the  U.S.  will  be  in  a  state  of  WAR,  HALF -WAR,  or  NO -WAR  in  any 
year,  k,  and  the  n's  are  the  number  of  transitions  into  the  various 
states  of  war  with  both  p  and  n  being  calculated  over  the  system's 
total  operating  life  span  of  T  years.    The  investment  cost  per  transition 
is  a  finite  cost  for  war  escalations  and  zero  otherwise. 


Using  this  approach  the  major  categories  of  wartime  costs  can 
be  tied  explicitly  to  system  wartime  effectiveness  analyses. 

A  mathematical  model  was  developed  by  TRW  Systems  Group 
[Ref.   1]  for  quantitative  determination  of  the  probabilities  and  frequen- 
cies of  war  under  the  following  conditions: 

(a)  The  model  operates  in  discrete  time 

(b)  The  unit  of  time  is  one  year 

(c)  Historical  data  from  1900  -  1967  is  considered 

The  purpose  of  this  paper  is  to  develop  a  mathematical  model  to 
quantitatively  determine  similar  probabilities  and  frequencies,  but 
one  which  operates  as  follows: 

(a)  The  model  operates  in  continuous  time 

(b)  The  unit  of  time  is  one  month 

(c)  Historical  data  from  1775  -  1970  is  considered. 
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II.     HISTORICAL  DATA 

The  military  activities  of  the  United  States  considered  significant 
in  the  context  of  this  paper  are  those  listed  in  The  Encyclopedia  of 
Military  History  [Ref .  2].    References  3,4,  and  5  were  useful  in 
determining  a  precise  commencement  and/or  termination  date  in  the 
case  of  several  of  the  conflicts  being  examined. 

For  the  purpose  of  categorizing  the  various  levels  of  military 
involvement,  the  state  of  WAR  is  defined  as  a  shooting  war  with  troop 
and  equipment  losses  which  has  a  distinct  effect  on  the  economy  of  the 
United  States.    The  state  of  HALF -WAR  is  defined  as  a  state  of  military 
involvement  where  troops  and  equipment  are  deployed,  but  either  losses 
are  relatively  light  or  the  economy  of  the  United  States  as  a  whole  is 
relatively  unaffected.    The  state  of  NO-WAR  is  the  state  of  relative 
peace  which  exists  when  neither  a  state  of  WAR  nor  a  state  of  HALF -WAR 
exists . 

The  following  interpretations  were  used  to  classify  the  historical 
data: 

1.  The  start  of  a  WAR  during  a  period  of  HALF -WAR  causes  a 
change  of  state  from  HALF -WAR  to  WAR. 

2.  The  start  of  a  HALF -WAR  during  a  period  of  WAR  causes 
no  change  of  state. 

3.  The  start  of  a  second,  distinctly  different,  HALF -WAR 

during  a  period  of  existing  HALF-WAR  causes  no  change  of 
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state,  but  simply  permits  the  existing  state  of  HALF -WAR 
to  continue  until  the  conclusion  of  the  longer  HALF-WAR, 
or  a  transition  into  a  state  of  WAR  occurs.    This  interpre- 
tation is  taken  because  the  calculations  of  cost-effectiveness 
in  this  paper  depend  only  on  the  intensity  of  military 
activity  and  not  on  their  theater  of  operation.    Similar  con- 
ventions apply  to  the  states  of  NO-WAR  and  WAR,  hence 
transitions  between  the  same  two  states  are  not  possible. 
4  .        A  change  of  state  from  HALF -WAR  to  WAR  cannot  occur  as 

the  result  of  a  combination  of  concurrent  HALF -WARS. 
5.         The  month  during  which  a  change  of  state  occurs  is  evaluated 

as  a  month  during  which  the  new  state  existed. 
It  is  not  the  author's  claim  that  this  interpretation  of  data  provides 
a  precise  categorization  of  the  conflicts  nor  that  the  list  of  military 
activities  considered  is  neither  lacking  nor  in  excess,  but  only  that  it 
provides  a  reasonable  data  base,  consistent  with  the  intent  of  the 
problem,  to  which  an  attempt  can  be  made  to  fit  a  stochastic  model. 
The  remaining  pages  of  this  chapter  contain  a  complete  list  of 
the  military  conflicts  considered,  along  with  their  classification  as 
states  of  WAR  (W)  or  HALF -WAR  (HW)  in  accordance  with  the  proposed 
scheme  and  a  graphical  representation  of  the  resulting  sequence  of 
state  transitions  (Figure  I). 
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AMERICAN  MILITARY  ACTION  1775  -  1970 

STATE  CLASSI- 
DATES  ACTION  FICATION 


Apr  1775  -  Apr  1783  War  of  the  American  Revolution  W 

Nov  1798  -  Sep  1800  Quasi  War  with  France  HW 

Jul  1801  -  Aug  1805  Tripolitan  War  HW 

Nov  1811  -  Jun  1812  Indian  War  against  Shawnees  HW 

and  Friction  with  Britain 

Jun  1812  -  Dec  1814  War  of  1812  W 

Mar  1815  -  Jun  1815  American  War  with  Algiers  HW 

(Barbary  Wars) 

Nov  1817  -  May  1818  First  Seminole  War  HW 

Apr  1832  -  Aug  1832  Black  Hawk  War  HW 

Dec  1835  -  Dec  1843  Second  Seminole  War  HW 

Jun  1835  -  Apr  1836  War  of  Texas  Independence  HW 

Mar  1846  -Feb  1848  U.  S.  -  Mexican  War  W 

Jan  1850  -  Oct  1879  American  Indian  Wars  HW 

Apr  1861  -  May  1865  Civil  War  W 

May  1885  -  Sep  1886  Apache  War  HW 

Dec  1890  -  Jan  1891  Sioux  War  in  South  Dakota  HW 

Apr  1898  -  Dec  1898  Spanish  -  American  War  W 

Feb  1899  -  Jul  1902  Guerrilla  War  in  the  Philippines  W 

Jun  1900  -  Oct  1900  Boxer  Rebellion  in  China  HW 

Jul  1902  -  Jul  1905  Moro  Campaign  HW 

Nov  1903  -Nov  1903  Panamanian  Revolt      "  HW 
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STATE  CLASSI- 
DATES  ACTION  FICATION 


Oct  1906  -  Dec  1909        Army  of  Cuban  Pacification  HW 

Jan  1912  -  Jan  1913  Intervention  in  Honduras  and  HW 

Nicaragua 

Apr  1914  -  Nov  1914         Tampico  and  Vera  Cruz  Incidents  HW 

Jul  1915  -  Sep  1915  Intervention  in  Haiti  HW 

Mar  1916  -Feb  1917         Mexican  Border  Operations  HW 

against  Pancho  Villa 

Nov  1916  -  Jul  1924  Intervention  in  the  Dominican  HW 

Republic 

Apr  1917  -  Nov  1918         World  War  I  W 

i .  

Aug  1918  -Apr  1920  Expeditions  into  Northern  Russia  HW 

and  Siberia 

Jan  192  7  -  Nov  192  8         Intervention  in  Nicaragua  HW 

Jan  1931  -  Jan  1933  Intervention  in  Nicaragua  HW 

(The  Sandino  Affair) 

Dec  1941  -  Aug  1945  World  War  II  W 

Jun  1948  -  Sep  1949  Berlin  Blockade  HW 

Jun  1950  -  Jul  1953  Korean  War  W 

Jul  1958  -  Oct  1958  U.S.  Troops  to  Lebanon  HW 

Nov  1960  -  Dec  1960        U.S.  Warships  Protect  HW 

Guatemala  and  Nicaragua 

Dec  1961  -  U.S.  Support  Units  Arrive  in  HW 

South  Vietnam 

Oct  1962  -  Nov  1962        Cuban  Missile  Crisis  HW 

Aug  1964  -  Tonkin  Gulf  Resolution  W 

Apr  1965  -  May  1965        Intervention  in  Dominican  HW 

Republic 
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III.     MARKOV  PROCESSES 

This  paper  uses  continuous  time,  finite  state  MARKOV  Processes. 
The  definitions  and  special  properties  of  these  and  other  terms  which 
will  be  used  later  in  the  construction  of  the  mathematical  model  are 
developed  at  this  time  to  provide  continuity  in  the  later  sections . 

A.         FUNDAMENTAL  DEFINITIONS 

A  MARKOV  PROCESS  (MP)  is  a  special  type  of  stochastic  process 
distinguished  by  the  property  that  the  distribution  of  its  future  behavior, 
when  its  present  state  is  known,  is  not  altered  by  additional  knowledge 
concerning  its  past  behavior.    Specifically,  letting  {X    ;  t  =  0}    be  the 
stochastic  process,  it's  a  Markov  process  if, 


Pr(X    =  x 
t         n 
n 


X  x      -  ,  X  x     _  ,    ...  X    —  x. )  — 

t     ,       n-i       t     0       n-i  t,        1 

n-1  n-2  1 


Pr(X    =x 
t         n 
n 


Xt  =Xn     1} 

t     ,       n-i 
n-1 


where  0  <  t.  <  t_   <  . . .  <  t 

=    1=1=         =    n 

A  MARKOV  CHAIN  (MC)  is  a  discrete  time  Markov  Process, 

(n  =  1,2,3,...),  with  a  finite  number  of  states .    The  common  assumption 

that  the  transition  probabilities  are  stationary,  i.e.  ,  dependent  only 

on  the  states  i  and  j  and  not  on  the  time  n,  is  assumed  in  this  paper. 

The  law  of  motion  for  the  process  may  then  be  described  by  the  one 

step  transition  probabilities  of  going  from  state  i  to  state  j, 


pii " Pr  \+i = ! 


xn  =  i) 
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A  TRANSITION  MATRIX  is  a  finite  array  of  real  numbers  which 
specify  the  one  step  transition  probabilities  of  going  from  state  i  to 
state  j, 


Pij  =  ^  Vl  =  j 


X    =i), 

n 


hence  they  satisfy  the  conditions  that  for  every  i  and  j, 

P..  >  0 

ij  = 

s 
and      /_,        p..  =  1 

The  classification  of  the  states  of  a  process  become  important 
when  dealing  with  the  asymptotic  properties  and  also  in  the  physical 
interpretation  of  the  states.    For  Markov  processes,  the  states  are 
classified  according  to  their  limiting  behavior.    Given  that  a  process 
is  initially  in  stata  j,  if  the  ultimate  return  to  state  j  within  a  finite 
period  of  time  is  a  certain  event,  state  j  is  called  POSITIVE  RECURRENT 
If  a  process  starts  in  state  j  and  subsequent  visits  to  state  j  can  only 
occur  at  times  t,  2t,  3t  .  . . ,  state  j  is  called  PERIODIC  with  period  t. 
A  state  which  is  not  periodic  is  called  APERIODIC  .    A  state  is  ERGODIC 
if  it's  positive    recurrent  and  aperiodic. 

In  this  paper  all  the  states  are  ergodic  and  the  properties 
developed  will  apply,  although  they  are  not  necessarily  restricted  to, 
processes  all  of  whose  states  are  ergodic. 

An  illustrative  definition  of  a  continuous  time  MP  with  a  finite 
state  space  is  that  it's  a  stochastic  process  which  moves  from  one 
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state  to  another  among  a  finite  number  of  states  with  successive  states 

visited  forming  a  Markov  chain.    The  process  stays  in  any  state  a 

random  length  of  time,  the  distribution  function  of  which  is  exponential 

and  dependent  on  the  current  state  as  well  as  the  next  state  to  be  visited 

Define  m..  as  the  mean  value  of  the  conditional  exponential  dis- 

tribution  for  the  length  of  time  spent  in  state  i  given  that  the  next 

transition  will  be  into  state  j,  and  m.  as  the  unconditional  mean  length 

of  time  spend  in  state  i.    The  relationship  between  m..  and  m.  is 

U  1 


.  =    )      p. .  m. . 
1        *t*      i]      i] 


m 
i        ' 
j 

The  unconditional  mean  length  of  time  spent  in  state  i  will  be 

a  positive,  finite  value  for  every  state  considered  in  this  paper,  i.e., 

0<  m.  <00 
l 

B.         LIMITING  PROPERTIES 

In  order  to  obtain  specific  values  for  many  of  the  expressions 
developed,  it  is  necessary  to  use  their  limiting  approximation  as  time 
approaches  infinity.    This  limiting  behavior  is  presented  in  this  section 

Given  that  a  transition  into  state  j  occurred  at  time  t  =  0,  the 

expected  time  until  the  process  next  enters  into  state  j  is  called  the 

MEAN  RECURRENCE  TIME  of  state  j  and  is  denoted  by  ft  .    The  value 

3 

of  the  mean  recurrence  time  of  state  j  is  the  summation,  over  all 
possible  paths  (9)  which  begin  in  state  j  and  terminate  at  state  j  with 
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no  intervening  visits  to  state  j,  of  the  probability  of  the  path  being 
taken  multiplied  by  the  expected  time  to  traverse  the  path. 

»:-       L  (7TPhk)  (7m   ) 

3  (hfk)   e  9 

Over  a  long  period  of  time,    (t    -*■  00) ,  if  all  states  are  ergodic 
and  m.     <  00  for  every  j,  the  probability  of  finding  a  Markov  Process 
in  any  state  j  equals  the  ratio  of  the  unconditional  mean  time  spent 
in  state  j  to  the  mean  recurrence  time  of  state  j . 

Specifically: 

limit       Pr  (X    =  j)  =  m.  /   & 
t  )/      3 

t    ->  00 

The  above  theorem  with  trivial  alterations     is  proven  by  Smith     [Ref .   6] 

After  a  period  of  time  t   >  >    3.  has  elapsed,  the  expected  number 

of  transitions  into  state  j  is  approximately  the  time  t  divided  by  the 

mean  recurrence  time  for  state  j.    Letting  n    (t)  be  the  number  of  tran- 

j 

sitions  into  state  j  during  [0,t], 


limit         n.  (t) 

J_  =     — L_  =  n 
t  *  00      t  a  j 


The  expected  number  of  those  transitions  into  j  which  came  from  state 

i  is,  in  steady  state,  the  number  of  transitions  into  state  i  times  the 

probability  of  a  transition  from  i  into  j. 

n..  =  n.p. . 
i]        1  13 
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C.        SEMI    MARKOV  PROCESSES 

A  generalization  of  the  definition  of  a  Markov  process  with  regard 
to  the  distribution  function  of  the  time  spent  in  each  state  results  in  a 
Semi-Markov  Process  (SMP) . 

A  descriptive  definition  of  a  finite  state  SMP  is  that  it  is  a 
stochastic  process  which  moves  from  one  state  to  another  among  a 
finite  number  of  states  with  successive  states  visited  forming  a  Markov 
Chain.    The  process  stays  in  any  state  a  random  length  of  time  the 
distribution  function  of  which  may  depend  on  the  current  state  as  well 
as  the  next  state  to  be  visited. 

Notice  that  the  only  difference  between  a  MP  and  a  SMP  is 
whether  or  not  the  conditional  distribution  of  the  length  of  time  spent 
in  each  state  is  exponential . 

The  development  of  the  SMP  which  follows  is  based  on  that  given 
by  Pyke  [Ref .  7] . 

Define  Q..  (t)  as  the  probability  that,  given  the  system  starts 
in  state  i  at  time  zero,  the  first  transition  is  into  state  j  and  that  it 
occurs  on  or  before  time  t. 

Then  Q  =  (Q..),  is  an  s  x  s  matrix  valued  function  defined  on 

(-00,  +00),  whose  elements  Q..  are  non-decreasing  functions 

13 


satisfying 


(1)  Q      (t)  =  0  t  <  0 
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s 
and  (2)      L      Q„(+00)  =  1  c  i  <=  s 


It  now  becomes  natural  to  define 


p..  =  Q..  (+  00) 
13         ij 


and  to  assume  that 


P..    >    0  i^  j 

i] 


and 


P..  -  0  1  -  j       . 

so  that  the  s  x  s  matrix,  P  =  (p..),  becomes  the  transition  matrix  for  the 

Markov  Chain  describing  the  sequence  of  states  visited. 

The  probability  of  leaving  state  i  before  any  time  t,  independent 

of  which  state  you  go  into  next,  is  the  unconditional  distribution 

function  of  the  time  spent  in  state  i  and  is 
s 

Q-   W  =     L       Q1(  W  1  <  i<   s 

1  j=l  1J 

The  distribution  of  time  in  state  i,  given  that  the  next  transition 

will  be  into  state  j,  is  simply 

Q.  ,  .  (t)  =     __U if] 

1  i] 

The  following  notation  is  introduced  to  define  the  moments  of 
the  distributions  thus  far  discussed.    The  conditional  mean  and  con- 
ditional variance  of  the  length  of  time  spent  in  state  i  given  that  the 
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subsequent  transition  will  be  into  state  j,  are  respectively 
00 

W 


00 

/       t  d  < 


i|  J 


2  00 

,   =       f    (t  -  m..)2  dQ.,  . 
!3  J_  U  M3 


0 

and  the  mean  and  variance  of  the  length  of  time  spent  in  state  i  re- 
gardless of  the  subsequent  transition,  are 


00 


uu  s 

/     t  d  Q.  (t)  =     \       p..  m.. 


2  00 

a.    =       /      (t  -  m.)2  d  Q.  (t) 
i  J  11 

0" 

Notice  that  the  expressions  developed  for  the  asymptotic  con- 
dition as  t    -►  00  and  for  the  mean  recurrence  time  are  distribution  free. 
They  apply  equally  to  a  MP  and  SMP  as  long  as  the  distribution  function 
for  the  length  of  stay  in  each  state  has  a  finite  mean. 

D.        THE  ALTERNATING  PROCESS 

If  the  number  of  states  is  restricted  to  two  and  the  requirements 
maintained  that 

P..  >   0  i  ^  j 

and 
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Pij  =  o  -  I- J 

a  SMP  becomes  an  alternating  renewal  process  since 

p      >   0  implies    p     =  1  i,j  =  1,  2  and  i  ^  j 

ij  ij 

In  an  alternating  renewal  process  the  equation  for  mean  recurrence 
time  reduces  to  the  sum  of  the  mean  length  of  time  spent  in  each  state, 
because  the  p..  equal  either  zero  or  one  depending  on  whether  or  not 
i  equals  j,  and  is  the  same  for  both  states,  i.e., 

61    =  62    =ml+m2 

The  distribution  function  of  the  recurrence  time  is  the  convolution 
of  the  distribution  functions  which  specify  the  length  of  time  spent  in 
each  state.    Further,  the  fact  that 

Gl  *  G2  (y)  =  G2  *  Gl  (y) 
implies  that  in  a  two  state  alternating  renewal  process  the  distribution 
of  recurrence  time  for  each  state  is  the  same  and  may  be  called  the 
recurrence  distribution  of  the  process. 

Let  Y    and  Y?  be  random  variables  having  distribution  functions 

G,  and  G~  which  describe  the  length  of  time  spent  in  states  1  and  2 

respectively.    The  distribution  of  the  recurrence  time  (G) ,  is  the 

distribution  of  the  random  variable  Y  where  Y  =  Y,  +  Y    . 

1         2 


G(y)=    J   Gl(y-x2)dG2(x2) 
0 
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then 


As  a  specific  example,  let 


ax  x  x 

G     (x)  =  1  -  e"  and  G     (x)  =  1  -  e 


-    a    (y  -  x),  -Ax, 

G  (y)  =  G     *  G     =  /    [1  -  e  '  ]   X  e  dx 


0 

y  y 


-ay  +  ax-Xx. 
X  e  dx 


y  y 

/,      -    X    x  -ay  f 

Xe  dx-Xe  / 

0  0 

y 


e  dx 


-  X    x 
-e 


-    (    X  e"    a   Y)       e(     a"X      )X 
(    a  -X       ) 


-1-e"  /  Y    -     x    e"    ay    (e(    a"X    )y -1) 

(    a   -    X    ) 

-  1  -  e"    X   y  -  X  (e-    X   7  -  e"    a  y) 

(    a    -     X   ) 

Q.E.D. 
In  an  alternating  renewal  process,  the  probability  that  the  process 
is  in  state  1  at  time  t  is  the  sum  of  the  probability  that  state  1  was 
occupied  initially  and  the  length  of  time  spent  in  state  1  is  greater 
than  t,  and  the  probability  that  the  system,  independent  of  where  it 
started,  left  state  2  at  a  time  t' ,  for  some  t'    <    t,  and  the  stay  in  state 
1  is  greater  than  t  -  t' .    In  the  limit,  the  value  of  this  probability  is 
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m  m. 

limit      Pr(X    =  1)    =     7 =     

t  m1+m2  Bl 

t   ■»■  00 
A  formal  proof  using  the  strong  law  of  large  numbers  is  presented  by 
Cox  [Ref .  8] . 

Another  interpretation  of  the  above  equation  is  that  after  a  very 

large  number  of  transitions,  the  system  will  have  spent  a  proportion  of 

time  m,  /  &.  in  state  1 . 
1'      1 

Since  p,_  =  p?,  =  1,  the  expected  number  of  transitions  into 

state  2  from  state  1  as  t    ■>  00  equals  the  expected  number  of  transitions 

into  state  1 . 

n12=nl=76l 

E.         STATISTICAL  CALCULATIONS 

When  calculations  are  being  made  from  sample  data,  the  proba- 
bility of  a  transition  from  state  i  into  state  j  is  estimated  as  the  number 
of  observed  transition  from  state  i  into  state  j  divided  by  the  total 
number  of  transitions  from  state  i.    Specifically 

n. . 

P..=   — U 

ij  n 

1  \ 

where  n, .  is  the  number  of  observed  transitions  from  state  i  into  state  i. 

Similarly,  the  mean  length  of  time  spent  in  any  state  i,  con- 
ditional and  unconditional,  is  simply  the  arithmetic  mean  length  of 
time  spent  in  state  i  from  the  observed  data.    These  values  are  called 
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the  sample  means. 


t.       = 


i]  n, 


i] 


n. 


'Hi 


:=1 


and 


t.      =   

i  n, 


n. 


(k) 
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IV.     CURVE  FITTING 

The  method  of  moments  is  employed  for  parameter  estimation 
while  attempting  to  fit  a  continuous  distribution  function  to  the  data . 
The  single  parameter  exponential  distribution  is  assumed  and  the  sample 
mean  equated  to  the  assumed  population  mean  and  a  solution  obtained 
for  the  unknown  parameter. 

A.         THE  EXPONENTIAL  DISTRIBUTION 

The  exponential  distribution  function  is 

Q..(t)  =  l  -e"  a  ij  t 
i) 

has  a  mean  value 


E(t)  1  =    m 

a  . . 
1J 


and  a  variance 


2 

a 

= 

1 

z, 

a 

IJ 

A  convenient  attribute  of  the  exponential  distribution  is  its 
"Memoryless"  property.    This  property  specifies  that  if  the  length 
of  time  spent  in  any  state  k  is  distributed  exponentially,  the  remaining 
time  in  state  k,  given  it  has  already  been  in  state  k  for  some  time  t1  , 
is  a  random  variable  with  an  exponential  distribution  independent  of  t.  . 
A  proof  follows: 
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Q(t)  =  1  -  e 


q(t)  =   a  e 


-a   t 


Pr  (t  >_Z)  = 


00 


-at  -a    Z 

a  e  =  e 


Pr  (t  >  Z  +  t 


1 


t>  tx)  = 


Pr  (t  >  Z  +  t  ) 
Pr  (t  ^  tj) 


Pr  (t  >  Z  +  t. 


-a    (Z  +  t, )  -  a   Z 

=       e 1_    =    e 

e"atl 


t  >  t  )  =  Pr  (t  >  Z) 


Q.E.D. 


When  the  conditional  sample  mean  is  equated  to  the  mean  of 
the  exponential  distribution  in  accordance  with  the  hypothesis,   (Ho), 
that  the  conditional  time  in  state  is  distributed  exponentially,  the  results 
are: 


m. .  =  t.    I  .         ->       a 
ij       i     j  i] 


i      3 


B.         THE  KOLMOGOROV-SMIRNOV  GOODNESS  OF  FIT  TEST 

The  KOLMOGOROV-SMIRNOV  TEST  for  goodness  of  fit,   Massey 
[Ref.  9],  is  used  to  test  the  hypothesis  that  the  data  comes  from  an 
exponential  distribution.    The  test  is  based  on  a  comparison  of  the 
magnitude  of  the  maximum  difference  between  the  set  of  sample  values 
and  the  theoretical  cumulative  distribution  as  compared  with  tabulated, 
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critical  values  for  the  appropriate  sample  size  at  a  specific  level  of 
significance.    Specifically,  if  the  assumed  cumulative  distribution  is 

Q..(t)  =  1  -e~     "ij1 
ij 

and  the  observed  cumulative  step-function  of  the  sample  is 


R..(t)  = r_ 

13 


where  r  is  the  number  of  observations  less  than  or  equal  to  t;  then  the 
sampling  distribution  of 

E..=  maximum       Q..(t)  -R..(t) 
ij  !      i]  13 

is  known  and  is  independent  of  Q..(t) . 

The  tables  associated  with  the  Kolmogorov-Smirnov  Test  give 

critical  values  of  the  distribution  of  E  for  various  sample  sizes.    For 

example,  at  a  0.20  level  of  significance,  the  critical  value  of  E  for 

n..  =  10  is  0.322;  this  means  that  in  20  percent  of  the  random  samples 
i] 

of  size  10,  the  maximum  absolute  deviation  between  the  sample  cumu- 
lative distribution  and  the  population  cumulative  distribution  will  be 
at  least  0.322.    If  the  calculated  value  of  E  is  less  than  this  critical 
value  there  is  no  reason  to  reject  the  hypothesis  that  the  sample  came 
from  the  assumed  distribution. 

Reference  10  also  compares  this  test  with  the  chi-square  test 
for  goodness  of  fit  and  notes  that  it  is  superior  in  many  cases. 
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V.    THE  TWO  STATE  MODEL 

The  two  state  model  considers  the  states  of  WAR  and  NO-WAR, 
and  will  be  developed  separately  for  each  of  the  two  possible  modes  of 
data  interpretation.    Initially  a  two  state  model  which  considers  each 
military  conflict,  regardless  of  intensity  or  economic  implications,  as 
a  state  of  WAR  will  be  formulated  because  this  is  the  typical  classi- 
fication in  studies  involving  cost-effectiveness.     (Weapons  systems 
employed  vs  weapon  system  not  employed.)    Subsequently,  the  inter- 
pretation of  data  such  that  all  military  conflicts  which  would  not  be 
classified  as  WAR  in  the  three  state  model  will  be  classified  as  NO-WAR, 

A.         THE  TRANSITION  MATRIX 

The  transition  matrix  for  both  of  the  two  state  cases  is  simply 
and  uninterestingly 

W  NW 


W 
NW 


0  1 

1  0 


B.         TWO  STATE  MODEL  (CASE  I) 

In  case  one,  all  the  periods  of  conflict,  regardless  of  intensity, 
are  considered  periods  of  war. 

The  periods  of  time  during  which  a  state  of  NO-WAR  existed, 
as  taken  from  Figure  1  are: 
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State  of  NW 


Length  (mo.) 


State  of  NW 


enqth  (mo.) 


Apr  1783  -  Nov  1798  187 

Sep  1800  -  Jul  1801  10 

Aug  1805  -  Nov  1811  75 

Dec  1814  -  Mar  1815  3 

Jun  1815  -  Nov  1817  29 

May  1818  -  Apr  1832  167 

Aug  1832  -  Jun  1835  34 

Dec  1843  -  Mar  1846  27 

Feb  1848  -  Jan  1850  23 

Oct  1879  -  May  1885  67 

Sep  1886  -  Dec  1890  51 

Jan  1891  -  Apr  1898  87 

Dec  1898  -  Feb  1899  2 


Jul  1905  -  Oct  1906 
Dec  1909  -  Jan  1912 
Jan  1913  -  Apr  1914 
Nov  1914  -  Jul  1915 
Sep  1915  -  Mar  1916 
Apr  1920  -  Jan  1927 
Nov  1928  -  Jan  1931 
Jan  1933  -  Dec  1941 
Aug  1945  -  Jun  1948 
Sep  1949  -  Jun  1950 
Jul  1953  -  Jul  1958 
Oct  1958  -  Nov  1960 
Dec  1960  -  Dec  1961 


15 

25 

15 

8 

6 

81 

26 

106 

34 

9 

60 

25 

12 


The  sample  mean  for  the  state  of  NO-WAR, 


n 


NW 


NW 


n 


NW 


I 


k=l 


00 

LNW 


1184      =45.5  months  =  3.8  years 
26 


Similar  calculations  for  the  state  of  WAR  yield  the  following 
result: 

\at    =         1153         =    42.7  months  =  3.6  years 
W  27 

The  value  of  42.70  months  for  the  mean  length  of  time  spent  in 

a  state  of  WAR  is  slightly  conservative  because  it  assumes  a  transition 

occurred  at  the  data  end  points,  i.e. ,  that  a  state  of  NO-WAR  exists 

in  March  1775  and  February  1970. 
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The  data  on  the  length  of  stay  in  each  state  is  assumed  to  have 

come  from  exponential  distributions  having  parameters       <*      =  0.0234 

W 

and      (*,.„.,  =  0.0220  and  mean  values  m,Ar  =  42  . 7  months  and  m,T,ir  = 
NW  W  NW 

45.5  months . 

-  - 
The  resulting  distributions,  Qw(t)  and  QKTW(t)  are  plotted  against 

their  respective  cumulative  step  functions  from  the  observed  date  in 

Appendix  A.     In  both  cases  the  Kolmogorov-Smirnov  test  for  goodness 

of  fit  gives  no  indication  that  the  exponential  assumption,    (Ho),  is 

invalid,  therefore  Ho  is  accepted. 

Functionally  these  distributions  answer  the  question,  "Given  that 

the  United  States  is  in  a  state  of  war,  what  is  the  probability  that  the 

war  ends  within  two  years,  five  years,  ten  years?"    The  answer,  for 

this  model  is: 

_      ,.  -.0234  t 

Qw(t)  -  1  -  e 

Pr  (t  <  2  yrs)  =  Qw  (24)  =  43% 

Pr  (t  <  5  yrs)  =  Q>       (60)  =  75% 
=  W 

Pr  (t  <  10  yrs)  =  Qw  (120)  =  94% 

The  mean  recurrence  time  for  the  system  is 

*w  =  *nw  =  mw  +  mNW  =  88,2  months  =  1A  ye6rs 

The  limiting  probability  that  the  system  is  in  each  of  the  two 
states,  or  the  long  run  proportion  of  time  spent  in  each  state  is 


limit    Pr(X    =  NW)    =       mNW         =       45.5        =    52% 

t  -  00  W  88*2 
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limit    Pr(X  =  WAR)  =       "V  =       42.7       =    48% 

t  •*    00  &w  88-2 

The  distribution  function  of  the  recurrence  time  for  the  system, 

G(t)  =  Q      *  Q        (t) 
W         NW 

u  n     f  \       i         -.0234  x 

where  Q,.rvx)  =  1  -  e 

W 

.  ^        (  \  -  i         -.0220  x 

and  QNW(x)  "  l  "  e 

_,.       .         -.0220  t     ...    _.   ,  -.0220  t       -.0234  t 
is  G(t)  =  1  -  e  -(14.6)  (e  -e  ) 

Using  this  distribution  function  answers  can  be  obtained  to 

questions  such  as,  "Given  that  the  U.  S.  is  in  a  state  of  war  at  some 

time  t    ,  what  is  the  probability  that  the  U.S.  will  fight  in  a  second 
o 

war  within  ten  years  of  time  t     ? " 

o 


(2) 
Pr(X    =  WAR       ,  for  some  t,  t     <    t  <  10  yrs 
t  o  - 


X      =  WAR(1)) 
o 


=  G(120)  =  77% 
The  average  number  of  transitions  into  a  state  of  war  that  a 
system  with  a  life  cycle  of  thirty  years  should  expect  to  experience  is 

30  yrs      =    4  transitions 


*w 

7 . 4  yrs 

from  the  fact  that 

• 

,.     ,.        n.(t) 
limit          i 

1 

=    n. 

t     -"00 

6) 

3 
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C.        TWO  STATE  MODEL  (CASE  II) 

In  case  II  the  periods  of  half-war  and  relative  peace  are  grouped 
together  as  the  state  of  NO-WAR.    Only  the  major  military  conflicts 
classified  as  wars  in  the  three  state  model  are  called  states  of  WAR  in 
this  model. 

The  periods  of  time  during  which  a  state  of  WAR  existed,  from 
Figure  1 ,  are: 

STATE  OF  WAR  LENGTH  (months) 

Apr  1775  -  Apr  1783  96 

Jun  1812  -  Dec  1814  30 

Mar  1846  -  Feb  1848  23 

Apr  1861  -  May  1865  49 

Apr  1898  -  Dec  1898  8 

Feb  1899  -  Jul  1902  41 

Apr  1917  -  Nov  1918  19 

Dec  1941  -Aug  1945  44 

Jun  1950  -  Jul  1953  37 

Aug  1964  -  Jan  1970  65 

Notice  that  again  in  this  model  a  change  of  state  is  assumed  to  exist 

at  the  data  end  points . 

The  sample  mean  from  the  above  data,  for  the  state  of  WAR  is 

nw 

—  V-"  fo) 

t,AJ.    =1                 >           t.:/    =        412       =  41.2  months  =  3.4  years 
W         L-i  W  — — 

V         k-i  10 
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Calculations  for  the  state  of  NO-WAR  yield 

tl«»f    =        1925        =    213.9  months  =  17.8  years 
NW  - 

It  is  interesting  to  note  that  the  difference  in  the  average  time 
spent  in  a  state  of  WAR  between  Case  I  and  Case  II  is  less  than  two 
months,    (42.7  mo.  vs.  41.2  mo.)  yet  the  average  time  spent  in  a  state 
of  NO-WAR  varies  by  nearly  a  factor  of  five,   (45.5  mo.  vs.  213.9  mo.) 

The  test  of  the  hypothesis  that  the  data  is  from  exponential 

distributions  with  parameters      a,,r  =  0.0243  and      a>T„.=  0.0047  is 

W  NW 

contained  in  Appendix  B.    As  a  result  of  the  test,  the  exponential 

hypothesis  is  accepted. 

Given  that  the  U.  S.  is  in  a  state  of  NO-WAR  at  some  time  t    , 

o 

the  probability  that  the  country  will  escalate  into  a  state  of  WAR  during 
the  next  two ,  five  or  ten  years  is , 

q        {t)  =  1.e-'^7t 

VNWV  ' 

Pr(X    =  WAR,  for  some  t,  t    <     t  <  2  yrs  I  X„     =  NW)  =  Q>       r(24)  =  11% 
t  O  —  ■      t  IM  W 

o 

Pr(X    =  WAR,  for  some  t,  t    <      t  <  5  yrs  I  X      =  NW)  =  CD        (60)  =  24% 
t  o  =  t  NW 

1       o 


Pr(X    =  WAR,  for  some  t,t<     t<10yrs 
t  o  = 


Xt     =  NW)  =  QNW(120)  =  43% 
o 


The  mean  recurrence  time  for  the  system  is 

V  =  3NW  =  mW  +  mNW  =  "5. 1  mo  =  21 .3  years 
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The  limiting  probability  that  the  system  is  in  each  of  the  two 
states,  or  the  long  run  proportion  of  time  spent  in  each  state,  is 


limit    Pr(X    =  NW)  =    mNW        =      213.9  mo.      =    84% 
t   -   00  BNW  255.1  mo. 


limit    Pr(X    =  WAR)  =        "w       =        41.2  mo.      =    16% 
t    ■*•  00  3W  255.1  mo. 


The  distribution  of  recurrence  time  for  the  system, 


G(t)  =  O      *  Q  (t) 

11      VW      VNW  KJ 


where  Q-,.r(x)  =  1  -  e 

W 


a  o        /  a       i         -.0047 x 

and  QNWW  =  l  "  G 


_,.       .         -.0047  t      ,_    ...    .   -.0047  t         -.0243  L 
is  G(t)  =  1  -  e  -(0.24)  (e  -e  ) 

Given  that  a  state  of  peace  exists  at  time  t   ,  the  probability 

o 

that  the  U.S.  will  have  engaged  in  one  war  and  returned  to  a  state 

of  NO-WAR  within  ten  years  of  t     is 

o 

Pr(X      =  WAR,  Xfc     =  NW,  for  some  t.  and  t.  ,  t    <     t,   <    t_     <  10  yrs 
t1  t_  1  2       O  1  I    — 

X      =  NW)  =  G(120)  =  31% 
o 

The  average  number  of  escalations  into  states  of  WAR  that  a 
system  with  a  thirty  year  life  cycle  should  expect  to  experience  is 
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T  1  =         30  yrs  =    1  escalation 

V  21.3  yrs 


from  the  fact  that 


limit  j  =  1  =    n. 

t   ■*■  00       t  Rj 
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VI.    THE  THREE  STATE  MODEL 

The  interpretation  of  data  for  the  three  state  model  is  presented 
in  Figure  1 . 

A.         STATE  TRANSITIONS 

The  conditional  sample  mean  time  in  state, 


n. . 


I    t« 


Mi        -r—       k=i     lD 


t 

the  corresponding  values  of  the  exponential  parameter. 


(      ..)  = 


**U 


and  the  unconditional  sample  mean  time  in  state 

s 

t    =        2-         P..  t.  .. 
3=1         «    i|3 

will  be  calculated  and  the  three  state  transition  matrix  developed. 

It  must  be  noted  that  the  convenient  assumption  that  a  transition 
occurs  at  the  data  end  point  of  January  1970  is  of  no  value  in  this 
model  because  knowledge  of  the  next  state  is  not  a  certain  event.    The 
result  of  this  conditional  dependence  on  the  next  state  visited  is  that 
the  unconditional  mean  time  spent  in  the  state  of  WAR  will  be  conserva- 
tive since  it  was  computed  from 
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"V 


=    t 


w 


p..  t.  I  . 
i]  1 1  j 


and  neither  t      ,„...  nor  t    .  .    ...  considers  the  length  of  the  Vietnam 
W    NW  W    HW 

conflict  which  has  as  a  minimum  length  a  value  which  would  cause  an 
increase  in  the  computed  average  time  spent  in  a  state  of  WAR. 


NW  - 

-  HW 

Nov  1798 

187 

Jul  1801 

10 

Nov  1811 

75 

Mar  1815 

3 

Nov  1817 

29 

Apr  1832 

167 

Jun  1835 

34 

Jan  1850 

23 

May  1885 

67 

Dec  1890 

51 

Oct  1906 

15 

Jan  1912 

25 

Apr  1914 

15 

Jul  1915 

8 

Mar  1916 

6 

Jan  1927 

81 

Jan  1931 

26 

Jun  1948 

34 

Jul  1958 

60 

Nov  1960 

25 

Dec  1961 

12 

953  mo. 

NW 

-  W 

Mar  1846 

27 

Apr  1898 

87 

Feb  1899 

2 

Dec  1941 

106 

Jun  1950 

9 

231  mo. 

PNW-W 


=  5/2  6  =  0.19 


m 


=  t. 


NW-W        NW  |  W 


=  46.2  mo 


=3.9  yrs 


°NW-W=0-0216 


m         =  45.5  mo.  =3.8  yrs. 

N  vv 
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PNW-HW  =  21/26=0-81 


mNW-HW  " 

tNW 

|  HW 

15.4  mo. 

a  NW-HW 

=  0. 

.0220 

HW  - 

NW 

Sep  1800 

22 

Aug  1805 

49 

Jun  1815 

3 

May  1818 

6 

Aug  1832 

4 

Dec  1843 

102 

Oct  1879 

173 

Sep  1886 

16 

Jan  1891 

1 

Jul  1905 

36 

Dec  1909 

38 

Jan  1913 

12 

Nov  1914 

7 

Sep  1915 

2 

Apr  192  0 

17 

Nov  1928 

23 

Jan  1933 

24 

Sep  1949 

15 

Oct  1958 

3 

Dec  1960 

1 
554  mo. 

=  3.8  yrs . 


HW  ■ 

-  W 

Jun  1812 

7 

Apr  1861 

135 

Apr  1917 

13 

Aug  1964 

32 

187  mo 


PHW-W=4/24  =  0-17 


m 


=  t, 


HW-W        HW|  W 


=  46.8  mo 


=  3.9  yrs. 


a  =  0.0214 

HW-W 


mT_,  .  =  30.1  mo.  =2.5  yrs . 
HW 


p  =  20/24  =  0.83 

HHW-NW  x 


m 


=  t. 


HW-NW        NW  |  HW 
=  0.0361 


=  27.7  mo.  =2.3  yrs 


a 


HW-NW 
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w  - 

NW 

Apr  1783 

96 

Dec  1814 

30 

Feb  1848 

23 

Dec  1898 

8 

Aug  1945 

44 

Jul  1953 

37 
238  mo. 

PW-NW  ~ 

6/9  = 

=  .67 

W  - 

HW 

May  1865 

49 

Jul  1902 

41 

Nov  1918 

19 

109 

mo. 

mW-NW  =  tw|NW  =  39-7m°- 

=  3.3  yrs . 

=  0.0252 


W-NW 


p  =  3/9  =  .33 


"V-hw-VIhw"36'31110' 

=  3.0  yrs. 


°W-HW=0-0275 


rru^  =  3  o .  6  mo  .=3.2  yrs  . 


The  resulting  transition  matrix  is 
NW  HW  W 


NW 


HW 


W 


0 


.83 


.67 


.81 


.33 


.19 


.17 


The  distribution  functions  Q..(t)  and  R..(t)  are  plotted  for  each  i 

and  j,  and  the  value  of  E     is  determined  in  Appendix  C.    In  no  case 

iJ 

is  any  cause  for  rejection  of  the  hypothesis  found,  therefore  it  is 

accepted  that  the  conditional  time  in  state  is  exponentially  distributed 

making  the  Semi-Markov  process  actually  a  Markov  process. 
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The  matrix  of  conditional  transition  distributions,  Q  =  (Q    ) ,  is 

ij 

NW  HW  W 

0  .81  (l-e-'0220t)  .19(l-e"0216t) 


NW 
HW 
W 
and  the  unconditional  distribution  of  time  spent  in  each  state, 


QO  .       -.03611  ,       -.02141 

.83  (1-e                )  0  .17  (1-e                ) 

c_  ,.      -.02521  ,„   n      -.02751                                   _ 

.67  (1-e                )  .33  (1-e                )                                 0 


Qi(t)=      L    Q„(t) 

3  J 


I 


is: 


n        m  -  i       f   on    ~.0220t        ,   ,Qx    -.0216t 
NW  (.81)e  -  (.19)e 

o        /^_i       /   qq\    -.0361t       ,   .„,    -.0214t 
QrTTAr^  =  1  "  (-83)e  "  (.17)e 

HW 

n      m  -  i       /  C7^Q-•0252t        /  o^   -.0275t 
Q      (t)  -  1  -  (.67)e  -  (.33)e 

The  following  questions  are  typical  of  those  which  can  be 
answered  using  these  distribution  functions. 

Given  that  a  state  of  HALF-WAR  currently  exists,  what  is  the 
probability  that  an  escalation  into  a  state  of  WAR  will  occur  within 
the  next  five  years  and  prior  to  a  de-escalation  into  a  state  of  peace? 
Statistically  the  question  asks  for  the  product  of  the  probability  that 
the  next  transition  is  from  HW  into  WAR  and  the  probability  that  the 
transition  occurs  within  the  next  five  years . 

The  answer  is  obtained  by  simply  evaluating  the  appropriate 

element  of  the  Q  matrix,  at  a  time  equal  to  five  years.    In  this  case 

.17  (1  -  e"*  )  =  12%  at  t  =  5  years. 
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Given  a  state  of  WAR  exists ,  what  is  the  probability  that  a  de- 
escalation  will  occur  within  the  next  five  years? 

o     m  -  i       (  G7\Q--0252t       i  o<^    -.0275t 
Q     (t)  -  1  -  (.67)e  -  (.33)e 

Qw(60)  =  79%. 


B.         MEAN  RECURRENCE  TIMES 

The  equation  for  mean  recurrence  time, 


*im    I   (  n  phk»  <  I  "W 

(h,k)   e  9 


may  be  described  in  a  form  more  responsive  to  computational  manipu- 
lations by  attempting  a  "brute  force"  approach  when  the  number  of 
states  is  sufficiently  small  to  permit  this  tactic.  [  1 

For  example,  in  a  basic  three  state  model,         (    2    ) (    3 

by  beginning  in  state  1  and  considering  initially 

only  those  paths  whose  first  transition  is  into  state  2,  it  is  possible 
to  write  an  expression  for  the  average  length  of  time  it  would  take  to 
traverse  each  possible  path,  from  state  1  back  into  state  1,  times  the 
probability  of  such  a  path  being  taken.    For  two,  three  and  four  tran- 
sitions, the  expressions  are  respectively: 

P12P21  (m12  +  m21) 


P12P23P31   (m12+m23+m31) 


P12   ^23  P32}  P21  (m12  +  m23  +  m32  +  m21} 
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It  will  soon  be  evident  that  the  paths  being  described  which 

contain  an  even  number  of  transition  form  the  series 

00  k 

£         P12  P21  (P23  P32}      [m12  +  r"'21  +  k(m23  +  m32)] 

k=0 

and  those  containing  an  odd  number  of  transitions  form  the  series 

P12  P23  P31   (P32  p23}      [m12  +  m23  +  m31  +  k  (m32  +  m23)J 
k=0 

Notice  that  this  approach  applies  because  p     =0. 

li 

Because  of  symmetry  in  the  mod^l  the  paths  from  state  1  which  go 
initially  into  state  3  form  identical  series  with  the  subscripts  2  and  3 
reverse.    Therefore,  all  possible  first  passage  paths  from  state  1  may 
be  explicitly  counted. 

As  stated  previously,  the  product  of  the  average  length  of  time 

spent  traversing  each  of  these  paths  and  the  probability  that  such  a 

path  will  be  selected,  w";en  summed  over  all  possible  paths  becomes 

the  mean  recurrence  time  fe),  which  in  this  instance  is 

00 

»1  =        £       P12  P21  (P23  P32)k   [m12  +  m21  +  k  (m23  +  m32)] 
k=0 

00 

+   Z   P12  P23  P31  ^32  P23}  [  m12  +  m23  +  m31 

+  k(m32+m23)] 
(cont'd) 
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00 


+        L      P13P31   (p32P23}      [m13  +  m31+k(m32+m23)] 


k=0 
00 


+       L      P13  P32  P21   ^23  P32}      [m13  +  m32  +  m21 

k=0 

+  k(ni      +  m     )1 
23         32  J 

the  term,   (p       p     ) ,  will  always  be  less  than  one,  hence  upon  expanding 

the  above  equation,  each  term  may  be  recognized  as    either  a  geometric 

series  or  a  simple  variation  thereof,  both  of  which  have  limits. 

Specifically, 

00 

/         a  p      =        a  p   <    1 

£o  (1  -  p> 

00 


/         a  k  p      =        a  p  p     <  1 

k=0  (1  -  p)2 


The  equation  for  mean  recurrence  time  becomes 

h  =  <_ 1 )[p12  P21  On     +  m21) +  P12  P23  P31ta12  +  m23  +  "»31) 

1  -  P23  P32 
+  P13  P31  (m13  +  m3l'  +  P13  P32  P21  (m13  +  m32  +  m21>] 


+    P23  P32 


(1'P23  P32)2 


[m32+m23][P12  P21+P12  P23  P31+P13  P31+P13P32  P2l] 
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When  this  equation  is  used  for  the  calculation  of  mean  recurrence 

times  the  following  results  are  obtained: 

6  '  r  =  2  52  . 5  months  =21  years 
W 

B     ,r  =94.7  months  =7.9  years 
HW 

K^.r  =87.4  months  =  7.3  years 
NW 

The  interpretation  placed  on  these  values  is  that  over  a  great  many 
years  the  average  length  of  time  the  United  States  spends  between  states 
of  WAR  is  twenty-one  years,  between  states  of  NO-WAR  approximately 
seven  years  ,  etc . 

A  comparison  can  be  made  between  the  mean  recurrence  times 
suggested  by  the  model  and  the  arithmetic  average  recurrence  times 
from  the  data,  however,  it  should  be  noted  that  very  close  agreement 
should  only  be  expected  between  the  mean  recurrence  times  for  WAR. 
The  end  points  of  the  data  are  both  states  of  WAR  Vierefore  the  arithmetic 
average  time  between  states  of  WAR  involves  no  assumptions  and  should 
agree  with  the  value  suggested  by  the  model. 

The  longest  interval  between  states  of  HALF -WAR  is  the  con- 
servative 283  months  which  occurs  before  the  first  HALF -WAR.    Current 
events  indicate  that  the  length  of  the  Vietnam  conflict  is  also  a  con- 
servative value  and  when  applied  as  a  mean  recurrence  time  for  HALF- 
WAR  it  becomes  even  more  conservative  because  it  may  be  followed  by 
a  period  of  NO-WAR  before  a  recurrence  of  HALF -WAR.    A  similar 
argument  applies  to  the  state  of  NO-WAR;  therefore  it  is  expected  that 
the  arithmetic  average  recurrence  time  for  HW  and  NW  will  be  less  than 

the  value  suggested  by  the  model. 
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The  values  of  mean  recurrence  time  compare  as  follows: 


State 


WAR 


HALF -WAR 


NO -WAR 


calculated 
value  from  the 
model 

253  mo. 

95  mo. 

87  mo. 


arithmetic 
average  value  from 
the  data 

214  mo. 

64  mo. 

43  mo. 


The  large  disparity  between  the  calculated  and  sample  value  for 
the  state  of  NO-WAR  is  a  result  of  the  fact  that  of  the  ten  sample  points 
where  the  length  of  time  in  a  state  was  six  months  or  less,  seven 
appear  as  sample  values  of  recurrence  time  for  the  state  of  NO-WAR. 
Perhaps  the  tactic  of  "display  of  strength"  such  as  sending  warships 
to  protect  Guatemala  and  Nicaragua  in  late  1960  or  the  Cuban  Missile 
Crisis  in  1962  should  not  be  considered  as  states  of  HALF -WAR  because 
of  their  brevity  and  the  fact  that  weapons  per  se  were  not  expended. 
This  would  certainly  decrease  the  variance  between  the  two  values  in 
question.    Yet  the  possibility  that  the  appearance  of  the  majority  of 
the  small  sample  values  as  intervals  between  states  of  NO-WAR  may  be 
classified  statistically  as  an  unusual  sample  cannot  be  dismissed.    The 
sensitivity  of  the  model  to  changes  in  data  base  is  not  investigated 
in  the  paper,  however  it  is  assumed,  as  an  alternative  to  declaring  the 
model  a  misfit,  that  a  less  than  optimal  method  of  historical  data  clas- 
sification plus  the  occurrence  of  a  statistical  rare  event  account  for 
the  difference  between  the  two  values  . 
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C.        PROBABILITY  OF  STATE  OCCUPATION 

The  limiting  probability  of  finding  the  system  in  each  of  the  three 
states , 

limit       Pr(X    =  j)  =  ] 

t   +  00  e. 

J 

is: 

limit       Pr(X    =  WAR)  =     38.6        =    15% 
t    •*  00  t  252.5 


limit       Prfc    =  HW)  =       30.1       =    32% 
t   +   00  94.7 


limit       Pr(X    =  NW)  =       45.5       =    52% 
t  -»-   00  t  87.4 

The  probabilities  do  not  sum  to  one  because  the  mean  time  in 

state  was  calculated  as  the  sum  of  the  conditional  mean  times  and 

therefore  precluded  the  use  of  all  the  data.    The  difference  of  1%  is 

considered  insignificant. 

D.         NUMBER  OF  ESCALATIONS  INTO  WAR  STATES 
Employing  the  limiting  probability  that 

ii     it         n-(t)  i 

limit  i  =  1  =    n, 

t    +  00       t  6.  j 


and  the  fact  that 

n..  =  n.  p. . 
lj        i  ^lj 

the  following  type  of  questions  can  be  answered. 
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Given  a  weapon  system  with  a  thirty  year  life  cycle,  the  average 
number  of  war  escalations,  of  each  type,  it  should  expect  to  witness  is 

nNW-HW  T  =  nNW  PNW-HW  T  =  — (*81)   (30)  =  3  escalations 

nNW-W  T  =  nNW  PNW-W  T  =  — * (* 19)   (30)  =  l  escalation 

7.3 

nHW-W  T  =  nHW  PHW-W  T  = (•  17)  (30)  =  1  escalation 


E.         LIFE  CYCLE  COST  EQUATION 

Using  the  limiting  values  obtained  for  the  three  state  model,  the 
long  run,  average  life  cycle  cost  equation  of  chapter  I  can  be  written 
more  explicitly  for  a  weapon  system  with  a  life  cycle  of  T  years,  as: 

Life  Cycle  Cost  =  (R&D  cost)  +  (Peacetime  Investment  cost) 

+  (.111  T)  (Investment  cost/transition) „„„  „,„ 

NW-HW 

+  (.026  T)  (Investment  cost/transition) 

+  (.021  T)  (Investment  cost/transition)TT„Ar  _._ 

HW-W 

+  (.52  T)  (Annual  Ops.  Cost  ) 

+  (.32  T)  (Annual  Ops.  CostHALF_WAR) 

+  (.15  T)  (Annual  Ops.  Cost^     ) 

In  this  form  it  is  conceivable  that  such  an  .-quation  could  be 
of  value  to  a  decision  maker. 
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VII.    COMPARISON  OF  RESULT  FROM  EACH  MODEL 

The  following  is  a  tabulation  of  the  important  results  from  the 
three  cases  investigated.    All  times  are  in  months,, 

2  -  State  3  -  State 

Case  I  (HW=W)  Case  II  (HW-NW) 

mXTTAr45.5  213.9  45.5 

NW 

mHW  30.1 


"V 


42.7  41.2  38.6 


£88.2  255.1  87.4 

NW 

3  94.7 

HW 


*W 


88.2  255.1  252.5 


limit       Pr(X  =NW)      .52  .84  .52 

t  -*    00 

limit       Pr(X=HW)  .32 

t     +00 

limit       Pr0C  =W)  .48  .16  .15 

t   ->oo        t 

The  results  provided  by  Case  I  of  the  two  state  model  compare 
more  favorably  with  the  results  of  th-  three  state  model,   (except  for  the 
mean  recurrence  time  of  war)  than  those  of  Case  II,  however  it  should 
not  be  assumed  from  this  that  Case  I  is  to  be  preferred  to  Case  II. 

If  conditions  necessitated  the  use  of  a  two  state  model  the  nature 

of  the  problem  and  type  of  solution  desired  would  indicate  the  more 

preferable  case . 
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VIII.     CONCLUSION 

In  the  author's  opinion,  the  area  most  susceptible  to  error  is  that 
of  data  identification  and  classification.    Further  it  is  felt  that  this 
error  will  be  minimized  if  the  historical  data  utilized  is  restricted  to 
conflicts  of  the  specific  type  or  style  of  combat  being  considered  in 
the  problem  at  hand.    For  example,  in  a  cost-effectiveness  study  for 
the  selection  of  the  best  among  several  amphibious  landing  vehicles 
the  historical  data  should  be  restricted  to  conflicts  which  included 
amphibious  assaults. 

The  reader  is  warned  against  using  the  model  to  predict  a  specific 
event  or  to  answer  questions  such  as,  "Given  the  U.  S.  is  in  a  state 
of  WAR  in  January  1970,  what  is  the  probability  that  the  war  will  end 
by  January  1973?"    The  values  obtained  from  the  model  are  the  average 
values  to  be  expected  over  a  long  period  of  time  and  their  use  in  pre- 
dicting individual  occurrences  should  be  avoided. 

The  simplicity  of  the  model,  as  indicated  by  the  fact  that  all 
the  calculations  can  be  done  by  hand,  should  encourage  its  use  as  a 
tool  in  cost-effectiveness  methodology  and  encourage  an  extension  of 
the  technique  to  other  applications  . 
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